Data Flow Graph Partitioning Schemes

نویسندگان

  • Avanti Nadgir
  • Harshal Haridas
چکیده

The ordering of operations in a data flow program is not specified by the programmer, but is implied by the data dependencies. This advantage can be exploited further on multiprocessor architectures by grouping the nodes in the corresponding data flow graph and allocating these groups efficiently to processors. This paper presents and compares some of the numerous heuristic approaches that were proposed to partition data flow graphs and assign them to different processors. The processor allocation algorithms, which do not consider the communication cost between processors, are presented initially. A Region analysis algorithm that enables better load balancing but again does not consider communication cost is presented. Schauser et. al. developed an intermediate data structure “dual graph” to transition a data flow graph into threads which easily compiled and mapped on Threaded Abstract Machine. Lastly, algorithms, which consider these costs, are studied. We present a design pattern that can be summarized from these algorithms to efficiently partition data flow graphs. We also list the key issues that need to be addressed during data flow partitioning. Abstract: .................................................................................................................................................................. 1

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Wavefront Diffusion and LMSR: Algorithms for Dynamic Repartitioning of Adaptive Meshes

ÐCurrent multilevel repartitioning schemes tend to perform well on certain types of problems while obtaining worse results for other types of problems. We present two new multilevel algorithms for repartitioning adaptive meshes that improve the performance of multilevel schemes for the types of problems that current schemes perform poorly while maintaining similar or better results for those pr...

متن کامل

Querying Distributed RDF Graphs: The Effects of Partitioning

Web-scale RDF datasets are increasingly processed using distributed RDF data stores built on top of a cluster of shared-nothing servers. Such systems critically rely on their data partitioning scheme and query answering scheme, the goal of which is to facilitate correct and efficient query processing. Existing data partitioning schemes are commonly based on hashing or graph partitioning techniq...

متن کامل

Lecture : Flow - based Methods for Partitioning Graphs ( 2 of 2 )

Recall from last time that we are looking at flow-based graph partitioning algorithm. Last time, we covered the basics of flow-based methods, and we showed how they are very different than spectral methods. This time, we will discuss flow-based graph partitioning from an embedding perspective. We will see that flow-based algorithms implicitly embed the data in a metric space, but one that is ve...

متن کامل

Network-based study of Lagrangian transport and mixing

Transport and mixing processes in fluid flows are crucially influenced by coherent structures and the characterization of these Lagrangian objects is a topic of intense current research. While established mathematical approaches such as variational methods or transfer-operatorbased schemes require full knowledge of the flow field or at least high-resolution trajectory data, this information may...

متن کامل

Comparison of Coarsening Schemes for Multilevel Graph Partitioning

Graph partitioning is a well-known optimization problem of great interest in theoretical and applied studies. Since the 1990s, many multilevel schemes have been introduced as a practical tool to solve this problem. A multilevel algorithm may be viewed as a process of graph topology learning at different scales in order to generate a better approximation for any approximation method incorporated...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004